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Abstract 

A new type of cooperativity termed temporal cooperativity [Biophys. Chem. 105 
585-593 (2003), Annu. Rev. Phys. Chem. 58 113-142 (2007)], emerges in the signal 
transduction module of phosphorylation-dephosphorylation cycle (PdPC). It utilizes 
multiple kinetic cycles in time, in contrast to allosteric cooperativity that utilizes 
multiple subunits in a protein. In the present paper, we thoroughly investigate both 
the deterministic (microscopic) and stochastic (mesoscopic) models, and focus on the 
identification of the source of temporal cooperativity via comparing with allosteric 
cooperativity. 

A thermodynamic analysis confirms again the claim that the chemical equilibrium 
state exists if and only if the phosphorylation potential AG — 0, in which case the 
amplification of sensitivity is completely abolished. Then we provide comprehensive 
theoretical and numerical analysis with the first-order and zero-order assumptions 
in phosphorylation-dephosphorylation cycle respectively. Furthermore, it is interest- 
ingly found that the underlying mathematics of temporal cooperativity and allosteric 
cooperativity are equivalent, and both of them can be expressed by "dissociation 
constants" , which also characterizes the essential differences between the simple and 
ultrasensitive PdPC switches. Nevertheless, the degree of allosteric cooperativity is 
restricted by the total number of sites in a single enzyme molecule which can not be 
freely regulated, while temporal cooperativity is only restricted by the total number 
of molecules of the target protein which can be regulated in a wide range and gives 
rise to the ultrasensitivity phenomenon. 
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1 Introduction 

Biological signal transduction processes are increasingly understood in quantitative terms, 
such that the switching of enzymes and proteins between phosphorylated and dephospho- 
rylated states becomes a universal module '^-^l. The biological activity of a target protein 
is often wakened by the phosphorylation reaction catalyzed by a specific kinase, and re- 
strained by the dephosphorylation reaction catalyzed by a specific phosphatase, which is 
quite similar to the turning on and off procedure of an ordinary switch. 

One of the key concepts in PdPC signaling is the switching sensitivity: the sharpness 
of the activation of the substrate protein in response to the concentration of the kinase 
is basic in the perspective of metabolic control analysis, usually termed as Hill coefficient 
first proposed by A. V. Hill 

Actually, the research about the sensitivity of single-enzyme catalysis activity, also 
known as the allosteric cooperativity, has already been developed for about forty years, 
since the classic paper of Monod, Wyman and Changeux and Koshland, Nemethy and 
Filmer '^1. It is found in experiments that very few individual enzymes show positive 
cooperativity with Hill coefficient greater than 4. 

However, in the case of multi-enzyme systems such as the phosphorylation-dcphosphorylation 
module, the situation is quite different. In the early 1980s, Goldbeter and Koshland [''■''l 
discovered the ultrasensitivity phenomenon of a PdPC switch in terms of the zeroth or- 
der kinetics of kinase and phosphatase, where the Hill coefficient can be extremely high. 
Moreover, it has already been observed in experiments 1^1 . 

Recently, Qian has further elucidated the importance of open-system chemical 
reaction in terms of continuous ATP hydrolysis. It was found that the thermodynamic en- 
ergy aspect of the signal transduction plays an important role in further understanding the 
function of PdPC switches, which confirms the well-known belief that signal transduction 
in biological systems actually consumes energy ["I. 

Most of the previous models [6,9,12,13] built for the phosphorylation and dephospho- 
rylation module were traditionally based on deterministic, coupled nonlinear ordinary 
differential equations in terms of regulatory mechanisms and kinetic parameters, which 
are widely used in the field of computational biology [i^'-i^l. Nowadays, as there is a grow- 
ing awareness of the basic character of noise in the study of the effects of noise in biological 
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networks, it becomes more and more important to develop stochastic models with chemical 
master equations (CME) based on biochemical reaction stoichiometry, molecular numbers, 
and kinetic rate constants. Such an approach has already provided important insights and 
quantitative characterizations of a wide range of biochemical systems I^^^^^l , especially in 
recent studies on gene expression [24.25] 

On the other hand, these stochastic models for systems cell biology would exhibit 
nonequilibrium steady states (NESS), in which their mesoscopic properties can be rig- 
orously investigated from the trajectory point of view Pe-as]^ Moreover, several recently 
interesting experimental results can only be explained by stochastic models l^s]^ 

The aim of this paper is to thoroughly investigate temporal cooperativity P'l emerged in 
the signal transduction module of phosphorylation-dephosphorylation cycle (PdPC) and 
to compare it with allosteric cooperativity through both deterministic (macroscopic) and 
stochastic (mesoscopic) models. The analysis developed in the present paper indicates 
that the cooperativity in the cyclic reaction is temporal, with energy "stored" in time 
rather than in space as for allosteric cooperativity. This kind of cooperativity utilizes 
multiple kinetic cycles in time, in contrast to allosteric cooperativity that utilizes multiple 
subunits in a protein. 

It is necessary to emphasize that the essential similarities and differences between 
temporal cooperativity and allosteric cooperativity can only be put forward and discussed 
in stochastic models. 

In Section 2, we firstly introduce the deterministic and stochastic model of the phosphorylation- 
dephosphorylation cycle. A thermodynamic analysis confirms again the claim that the 
chemical equilibrium state exists if and only if the phosphorylation potential AG = 0; in 
this case the amplification of sensitivity is completely abolished (Section 3). 

In Section 4 and 5, we then provide comprehensive theoretical and numerical analy- 
sis with the first-order and zero-order assumptions in phosphorylation-dephosphorylation 
cycle respectively. 

Furthermore, it is interestingly found in Section 6 that the underlying mathematics 
of temporal cooperativity and allosteric cooperativity arc equivalent, and both of them 
can be expressed by "dissociation constants" , which characterizes the essential differences 
between the simple and ultrasensitive PdPC switches. Nevertheless, the degree of allosteric 
cooperativity is restricted by the total number of sites in a single enzyme molecule which 
can not be freely regulated, while temporal cooperativity is only restricted by the total 
number of molecules of the target protein which can be regulated in a wide range and 
gives rise to the ultrasensitivity phenomenon. 

More implications of biochemistry are included in the discussion of Section 7. 
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2 Reversible kinetic model for covalent modification 



Many references -^"1 have considered the important phosphorylation-dephosphorylation 

cycle (PdPC) catalyzed by kinase Ei and phosphatase E2, respectively. The phosphory- 
lation covalently modifies the protein W to become W*: 

W + Ei+ ATP ^W-Ei- ATP ^W* +Ei+ ADP: 
di ?? 

W* + E2^ W*E2 ^W + E2 + Pi. 

Then at constant concentrations for ATP, ADP and Pi, introducing the pseudo re- 
action orders ai = [ATP] , qi = [ADP] and q2 = ^2 [-^ ^] ) these reactions become 

ai 

Reaction Al : W + Ei ^ WEi; 
Reaction A2 : WEi ^W* + Ei; 

31 

Reaction A3:W* + E2^ W*E2; 

d2 

Reaction AA : W* E2 ^ W + E2. 

This biochemical scheme is also isomorphic to another important module in cellular 
signal transduction across the cell membrane, namely the GTPase system. 

Prom the chemical point of view, the total affinity '^1 (intracellular phosphorylation 
potential) through the chemical reactions AI — ^ A2 — ^ ^3 — ^ AA is 



AG = AGi + AG2 + AG3 + AG4 

.^1 oiM^ ki[WEi] , a^^*^ k2[W*E2] 

= UbT log . , + ksT log . + ksT log + ksT log , , 

di[WEi] qi[W*][Ei] d2[W*E2] q2[W][E2] 

= ksT log- — - — (1) 
diqid2q2 

= ksT log-/, 

where 7 = "iliq^-!^ '^^ called the energy parameter. 

Therefore, the system is in chemical equilibrium, if and only if AG = 0, i.e.7 = 1. 

For the sake of sticking to the main point, the complete deterministic and stochastic 
models as well as their thermodynamic analysis are all put in the Appendix. 

At the end of this subsection, it is indispensable to note that the sustained high 
concentration of ATP (~1 mM) and low concentrations of adenosine diphosphate (ADP) 
(~10 jjM) and Pi (orthophosphate) (~1 mM) give rise to an equilibrium constant of 
4.9 X 10^ M for ATP hydrolysis and the phosphorylation potential in a normal cell is 
approximately 12 kcal mol~^ '^^l 
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2.1 Reduced Mathematical models 

It is always supposed that the total concentration of W and W* is much larger than that 
of the kinase and phosphatase (i.e. Wt ^ Eit + E2T or equivalently Wt = \W] + \W*\) 
'■"'^l, therefore, we can reasonably assume that the time scale for the dynamics of enzymes 
El and E2 is much faster than that for the dynamics of W and W* . Consequently, 
the concentrations of W and W* can be recognized as constants when considering the 
dynamics of kinase Ei and phosphatase E2 , while the concentrations of Ei and E2 can be 
recognized as in steady states when considering the dynamics of W and W* . 

Therefore, the dynamics of kinase and phosphatase can be considered separably: 



{a):W + Ei% WEi ^W* + Ei 

di qi 
Qi do 

{b):W + E2^ W*E2 ^W* +E2 (2) 

The steady states in the above Michaelis-Menten kinetics has been solved in the classic 
enzymology I^^', and the fluxes from W to W* and from W* to W in reactions (a) and 
(b) of Eq. [1 are 

Vi[W] VilW*] 

^ ~^ Kl ~^ K* Kl ~^ K* 

and 

V2[W] v^iw] 

^ ^ K2 ^ K^ ^ + K^ 

respectively, in which the parameters Vi = kiEiT, Vi = diEiT, V2 = d2E2T and V2 = 
/C2-E2T are the maximal forward {W W*) and backward {W* W) fluxes of the 
reactions (a) and (b); and Ki = Ki = = ^^ii^, K2 = are the 

corresponding Michaelis constants. 

Of more interest is the free energy constant 

_ aifciaafea _ ViKlV2*K2 ^ vi{[W])v*2{[W*]) 
^~ diqid2q2 ~ V{KiV2K* ^ V2{[W])vl{[W*])' 
which doesn't vary with [W] and [W*], and moreover makes the model here not only more 
general but also more reasonable than the semi-quantitative model introduced in 

Hence our model is now reduced the form of Fig. [H which can be also found in the 
latest book and reduced further to 

MW]) 
W ^ W*, 

f2{[W*]) 

where fi = vi + V2 is the total flux from W to W* , /2 
to W, and [W] + [W*] = (constant). 



(3) 



+ Vn is the total flux from W* 
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2.1.1 Deterministic model 

The ordinary differential equation of tlie model ([3]) is 



^ = fi{WT-[W*])-h{[W*]), (4) 

whose steady state [W*Y' satisfies fi{WT-[W*Y') = f2{[W*Y'') and [W]'' = Wt-[W*Y'. 
What we concern most is the steady state fraction of phosphorylated protein W* , i.e. 



Y — Wt ' 

Beard and Hong Qian have written down the general equation for cf) = ' in 
the deterministic model under the restriction Wt 3> -Eir + E2T (Wt = \W] + \W*\)'- 

~ [^^ _ + + fS^^)K,Kl{K2 - K*) ' 

where 9 = u = and = ^^^^^2^2 ^ oifcioafca 

In general chemical situation, we always have ^ Ki, K2 3> K2K2 ^ VFy (i-e. 
9i) 92 1), then ii'* — ii'i K*, K2 — K2 ~ -^'2, W^T + ^2 ~ -^2, so the above equation 
can be simplified to 

de_f eKi_V]__ ^ll[^l-{^l + l)<i)\{(|)-l- ^) 

If we let the free energy parameter 7 tends to infinity, then /x = (i.e. = 92 = 0). 
From (l5|), one can get 

0(1-0 + ^) 
CJ = 



which is just the celebrated Goldbeter-Koshland equation [''1 in their pioneer work on 
zero-order ultrasensitivity. 

Solving the quadratic equation ([5]), one can get that 

^ = 2A ' 

where A = 1 + ^ - a(l + S = ^ + (1 + + - a[l - ^{1 + ^)], and 
C = fi{l + + O"-^. This expression is put forward by Qian in I^'. 

However, in such a deterministic model, the concentrations of phosphorylated protein 
W and its dephosphorylated state W* are both the ensemble-averaged quantities, which 
can not really exhibit the transition route between them and are unable to adequately 
reveal the intrinsic essence of temporal cooperativity. 
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2.1.2 Stochastic model: chemical master equation 

In order to illustrate the essence of temporal cooperativity, we should turn to the stochastic 
model-chemical master equation. Let V be the volume of the system, then the total 
molecule number of W and W* is N = WtV . Due to the existence of unavoidable 
fluctuations, one can not determine the molecule numbers of each species at any arbitrary 
time t, and instead can only determine the probability that the vector representing the 
molecule numbers of species W and W* is {N — i, i). According to ([3]), the chemical master 
equation model is illustrated in Fig. [21 where fi{^^)V is the transition density jumping 
from state {N — to (A^ — i — l,i + 1), and f2{y)V is the transition density jumping 
from state {N — i, i) to {N — i + 1, i — 1). 

Similar transition models have recently emerged in f^.ss]^ ]-,^^ Qf them did not explic- 
itly insert the volume parameter V into their models, ignoring the variety of stochasticity 
related with the volume. 

Denote the probability of the state {N — i, i) at time t as P{N — i, i; t), then it satisfies 
the chemical master equation 

f2{l/V)VPiN - 1, l;t) - MN/V)VP{N,0;ty, 

/i((A + 1 - i)/V)VP{N + l-i,i-l;t) 
+f2{{i + l)/V)VP{N - 1 - i,i + l;t) 

- [M{N - i)/V) + f2{i/V)]VP{N -i,i-t), i = 1,2,- ■■ ,N-1; 
fi{l/V)VPil,N - 1; t) - f2{N/V)VP{0, N; t). (7) 

In probability theory, such a random-walk model is called the one-dimensional birth- 
and-death process, which is a special Markov chain, and the above equation is called the 
Kolmogorov forward equation (also called Fokker-Planck equation) of the continuous-time 
Markov chain with transition density matrix Q = {q^n)^ in which 

' fi(.^)V, ^ = {N -i,i),rj = {N-i-l,i + l),i = 0,1,- ■■ ,N-1- 

f2{^)V, ^ = {N-i,i),i^ = {N + = !,■■■ ,N- 

-h{^)y - h{^)V, i = = {N -i,i),i = 1,2,- ■■ ,A-1; 

-f2{^)V, ^ = r? = (0,iV); 

0, else. 

Two points of importance are worth emphasizing: (i) there is a basic assumption for 
the validity of this reduced stochastic model ([7]), that is the time scale for the dynamics 
of enzymes Ei and E2 are much faster than that for the dynamics of W and W* so as to 



dP{N, 0; t) 
Jt 

dP{N-i,i;t) 
di 



dP{0,N;t) 
Jt 
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ensure the Markovian property of this simphfied model, especially when the functions fi 
and /2 are nonlinear; (ii) According to the Kolmogorov cyclic condition (See Appendix), 
since there is no cycles consisting of more than two states in the chemical master equation 
model (Fig. [2]), detailed balance condition is satisfied. However, the detailed balance 
condition of this reduced stochastic model does not allude to the chemical equilibrium 
state of the original model, because the reversibility(equilibrium) of the complete model 
(i.e. 7 = 1) is not equivalent to the reversibility of this reduced model. 

From d?]), in the steady state, the ratio of the probabilities of the states (A^ — i, i) and 



(A,0) is nj^i ^Mlg^^pZj = n;.=i [ '"''Tuivr ' \ (^^^ Appendix for derivation), 
then the steady distribution of the state (A^ — is 

Tji MiN+l-j)/V) 

and the averaged molecule number of W* is 

S^N -yri h{{N + l-j)/V) 



f,((^N+l-j)/V) 



{W* 



i=i /2(i/v) 

Similar to the deterministic model, we introduce the ratio of the averaged molecule 
number (W*) of phosphorylated protein molecules and the total molecule number A^, 



def {w*) E^i^n; 



\-- / _ Mj/V) (a) 



N 



f2(j/V) 



When A = WtV , it is easy to find that if j > [W*Y'V, then ^^^^^rt^TJ^^^ < 1, and 



if j < [W*Y^V, then ■^^'■'^^t^^^/y^•' > 1. Hence, the state with the highest probability is 



f2{j/V) 

/2 07 V) 

{WtV - [W*Y''V, [W*Y'V). When F ^ oo, all the probability will tend to centrahze on 
the state {{Wt — [W*Y'^)V, [W*Y'^V), which perfectly corresponds to the steady state of 
the deterministic model by the mathematical theory of T. Kurtz P"'. Consequently, we 
have (i;^) (j), when V — > oo. 

In this stochastic model, {(j)) does not usually have a simple explicit expression, but 
it will be shown in the following sections, under different reasonable approximations that 
correspond to the simple and ultrasensitive PdPC switches respectively, the expression of 
{(p) is then clear and definite. 

In addition, due to the nonlinearity of functions /i and /2, although {(p) cf) when the 
molecule numbers tend to infinity, the graph of {(p) is more gradual than that of (p, which 
is pointed out recently by Berg, et al. 
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2.1.3 Dissociation constants 



If the functions /i, /a are both hnear, i.e. fi{[W]) = ai[W], and f2{[W*]) = a2[W*] 

Ql/«2 . 
l+ai/a2 



In this case, according to dH) and ([9]), it is derived that {(j)) = (p = "i/"^ (hyperbohc) 



illustrating no cooperative effect. 

In order to estimate the degree of cooperative phenomenon in the PdPC switch, we 
introduce the dissociation constants similar to the Adair constants f^^' in the allosteric 
cooperative phenomenon. 

For the state {N + 1 — j, j — 1), there have already been (j — 1) molecules transited 
from W to W*, thus there are (N + 1 — j) ways of transiting for the next molecule of W 
to W* . Similarly, for the state (A^ — there have already been j molecules transited 
from W to W* , and there are j ways of transiting for the next molecule of W* back to W. 

Define quantities Kj = ffj}^(N+i-f)^/v) ' representing the "dissociation capability" of the 
j-th molecule in the state {N — j,j) transiting back from the activated species W* to the 
inactivated one W, which are called "dissociation constants" , and their reciprocals are rep- 
resenting the "association capability" of the j-th molecule transiting from the inactivated 
species W to the activated one W* , which can be called "association constants". 

In Section 6, we will show that the underlying mathematics of temporal cooperativ- 
ity and allosteric cooperativity are equivalent, and both of them can be expressed by 
"dissociation constants", which reveals the essential differences between the simple and 
ultrasensitive PdPC switches. So here it is worth rewriting the formula ([9]) by the disso- 
ciation constants as 

v^AT {N-l)\ 1 

2^i=i {i-iy.{N-iy.Yi'K, 

i^) = - . ^jv m 'i ' 
i\{N-iy. Yl]=^K, 



1 + Yli=i ih 



which is essentially same as the general Adair scheme of allosteric cooperativity (jl2p . 

With these in our model, there exists the temporal cooperative phenomenon if the 
quantities {Kj, j = 1,2, ■ ■ ■ , N} successively decreases, which means the more number of 
molecules of W* is, the larger the association constant of the next molecule transiting from 
the state W to W* becomes. Furthermore, the cooperative phenomenon appears more 
and more distinct when the gradient of the decreasing quantities {Kj, j = 1,2,- •• ,A^} 
increases. 



3 Chemical equilibrium state (7 = 1): no switch 

Sensitivity amplification requires energy consumption, and phosphorylation potential can 
be used to improve specificity in biomolecular recognition and robustness in cell develop- 
ment f^l 
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3.1 In the deterministic model 

When 7 = 1, this system is in chemical equilibrium state and we have ^^^j^Jj^ = J*^^j[^Jj^ = 
v*{\w*]) ~ f^jW^^ recalling fi = is a constant. Hence, by ([6]) </> = is a constant, 
which does not vary with the concentrations of the kinase and phosphatase, and implies 
that there is no biological switch here. 

It is necessary to point out that in the simplified equation (l5|), if 7 = 1 and (f) ^ 
then by canceling a nonzero factor 

Vi _ M'/'-i-fe) 



but the right side is negative since (j) is less than 1, which contradicts the left side. There- 
fore, this simplified equation still preserves the fact that the PdPC switch is a nonequilib- 
rium phenomenon (7 7^ 1), which confirms the significant belief that biological amplifica- 
tion needs energy. 

3.2 In the stochastic model 

The model discussed in l^' is deterministic. It will be shown here that the same conclusion 
also holds in the stochastic model. 

Since if 7 = 1, then /'"ii^Sn = ""^n^}}-, = ^«^m^Jn = MtS3t: and the steady distribution 

' ' f2{[W*]) vKlW]) v^lW]) ^"[W*]' 

of the state {N — i,i) is 71(^17)! /^V(l + /^)^(Binomial distribution), so 



EN ■ i 



which is the same as the quantity (j) in the deterministic model and also implies that the 
amplification of sensitivity is completely abolished. 

Furthermore, the dissociation constants {Ki, 1 < i < N} are all equal to ^, unaltering 
with the concentrations of kinase and phosphatase. 



4 Simple PdPC switch (7 7^ 1) 

4.1 Theoretical analysis of the first-order linear approximation (i.e. /i 
and /2 are linear) 

Suppose Wt <. Ki,K2 <. K*, K2 (non-saturated ), then 



w mn v,\w] v,\w] 
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and 

V*[W] Vy'lW] 

K* K* Vn\W*] VT\W*] 



^ ^ Ki ^ K* ^ ^ K2 ^ K* ^ 1 

are both first-order, which is just the ordinary PdPC switch discussed in 

The steady state of the deterministic model is \WY'^ = and [Ty*]*** = where 

— + — K* K* 

a = y i . And since ^ and + « , the equation ([5]) is reduced 

iq+iq 

to 

_ V,K* _ fijlit, + - ^i] 

i.e. 

6 + ^ a 



e + n + d/{ix'y) + 1 1 + a 
And in the stochastic model, the steady distribution of the state {N — i, i) is (from 
(©) ji/jvlj)| QV(l + a)^ (Binomial distribution), then 



{N-iy. 



i=l j!{Ar-i)! 

which is the same as the quantity <j) in the deterministic model. 

Furthermore, a = — ^ is an increasing hyperbolic function of Eit- So (0) = (p 

is also an increasing hyperbolic function of Eit illustrating no cooperative effect either, 
which implies that the N molecules of W and W* are all independent. 

In the real organism, the signal molecule is the kinase Ei, so one should use the total 
concentration Eit of Ei as the control parameter rather than = y^j^ used in I^"'. 

(l+a) 



Vijq 

The variance of the molecule number of W* is S = tt^^Ti^^t^) so the relative standard 
error is = \/^^ — > when F — > 00, according to the mathematical theory of Kurtz 



[34] 



4.2 Numerical verification by simulation 

Now, we could numerically analyze the cooperative effect in this simple PdPC switch. 

Fig. [3] illustrates the curve of (p with respect to Eit based on the formula ([6]) of the 
deterministic model @ of the simple PdPC switch without the first-order linear approxi- 
mation. It presents a simple hyperbolic curve, implying non-cooperative effect. 

Fig. m illustrates the curves of {(p) with respect to Eit in the stochastic model ([7]) of 
the simple PdPC switch without the first-order linear approximation at different volumes, 
all of which also presents the simple hyperbolic shape. 

Fig. ^represents the dissociation constants {Ki} of temporal cooperativity with differ- 
ent volumes. It is found that in such a simple PdPC switch, these dissociation constants 
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are all very close to 1 regardless of the variety of volumes, reconfirming no obvious coop- 
erative phenomenon. 



5 Ultrasensitive PdPC switch 

5.1 Theoretical analysis of the zero-order approximation 

Suppose K2,Kl > Wt > , K|(saturated) , and <. K2, Ki Kl, one can arrive at 
the limit case ( « and 0) 

Vi[W] V2[W] 

mw]) = v.{[W]) + V2{[W]) = + ^^tH^^^t^ - V,, 

Kl ^ Kl K2 ^ K'i 

and 

mw*]) = vim*]) + vim*]) = ^^,£\,w:, + ,^m\iw:^ - y^- 

^ ^ Kl ^ Kl ^ ^ K2 ^ K* 

These are both in zeroth order case, which should be considered as nonlinear since 
/i(0) 7^ and /2(0) 7^ 0. This is just the situations of ultrasensitive PdPC switch dis- 
cussed in 1^1 and zero-order ultrasensitivity phenomenon put forward by Goldbeter and 
Koshland The Hill coefficient of the response curve can approach thousands and tens 
of thousands. It is worth pointing out that such a limit case can only be achieved when 
7/1, since otherwise V1V2 ^ ViV^i which contradicts the zero-order approximation. 

In the deterministic model of this limit case, we have (j) = <^{Vi>V2*}' which is a step 
function with ideal infinite sensitivity. And in the stochastic model, the steady distribution 
of the state (A^ — hi) is -777- — — --(truncated geometric distribution), so 



^ m-'^'-i; (10) 

A- N(l+J:l,a') I 1/2 a = l, 

where a = is the ratio of the forward flux from W to W* and the backward fiux from 
^2 

W* to W. 

Obviously, {(p) is an increasing function of a, and consequently an increasing function 
of EiT- And when N — > 00, one has {(p) ^ 1, if a > 1; ((/>) — > 0, if a < 1 (See Fig. [6]). The 
classical Hill coefficient in this case nn = '^ '^aioga I W=- ~ ~'~ I' Therefore, when the 
total molecule number N tends to infinity, the Hill coefficient can increase to an arbitrary 
value. 

Hence, when the Michaelis constants Ki,K2 are quite small, the ultrasensitive coop- 
erative phenomenon emerges both in deterministic and stochastic models, although their 
sensitivities can not be as high as in the limit case discussed above. 
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5.2 Numerical verification by simulation 

Firstly, we investigate the cooperative phenomenon in the hmit case of zero-order approx- 
imation. 

Fig. [6] ilkistrates the curves of (0) with respect to Eit at different volumes in the 
stochastic model of ultrasensitive PdPC switch under the zero-order approximation, in 
which it is found that the sensitivities of these curves are increasing with the volumes 
(molecule numbers) and finally approaches the ideal jumping curve of (j) with infinite 
sensitivity. 

Secondly, we turn to discuss the cooperative phenomenon without the zero-order ap- 
proximation. 

Fig. [7] illustrates the curve of (j) with respect to Eit based on the equation ([6]) in 
the deterministic model (j4]) of the ultrasensitive PdPC switch without the zero-order 
approximation, whose sensitivity is less than that in Fig. [6] but much larger than that in 
Fig. H 

Fig. [8] illustrates the curves of (0) with respect to Eit at different volumes in the 
stochastic model ([7]) by formula ([9]) of the ultrasensitive PdPC switch without the zero- 
order approximation, in which it is found that the sensitivities of these curves are increasing 
with the volumes (molecule numbers). 

There is a significant difference in terms of the Hill coefficient (degree of steepness) 
between the zeroth order approximate solution (Fig. [6]) and the exact solution (Fig. [8]). 
Although the trend in both cases is the same, namely larger molecule numbers gives more 
cooperativity, the latter one clearly approaches a limit, which is just the curve of (f) with 
finite sensitivity in Fig. [71 This accords well with the famous mathematical theory of 
T.G. Kurtz which says the deterministic model is just the infinite volume limit of the 
chemical master equation as the concentration parameters are unaltered. 

Fig. [9] represents the dissociation constants {Ki} of cooperativity with different vol- 
umes. It is found that in the ultrasensitive PdPC switch, these dissociation constants 
clearly decrease, and the gradient increases with the total molecule numbers, suggesting 
more and more distinct cooperative phenomenon. 

6 Mathematical equivalence to allosteric cooperativity 

In this section, we will investigate the equivalence of the underlying mathematics in tem- 
poral cooperativity and allosteric cooperativity, both of which can be expressed by "dis- 
sociation constants", which also raises the essential differences between the simple and 
ultrasensitive PdPC switches (Fig. [5] and Fig. [9]). 
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Fig. [TU] is the general model of allosteric cooperative phenomenon including both the 
famous MCJ and KNF models [s.^ei^ which can all be expressed by the Adair scheme, first 
proposed by Adair I^'"' in relation to the binding of oxygen to haemoglobin. In this model, 
the concentration of the substrate S is fixed, and the vector (N — i, i) represents the state 
in which there are i sites occupied with substrates among the total N sites. 

It is very important to point out that Fig. [10] is nearly the same as Fig. [2l where the 
temporal cooperativity is on the scale of the sequential phosphorylation-dephosphorylation 
cycles. The sequential states in Fig. [2] are adjacent in time rather than in space which is 
the case in allosteric cooperativity. The model in Fig. [10] is a special case of the model in 

[21 when M^+^r''/^) - 
J^ig. [2|wnen — j^jjjv) — iKl • 

Meanwhile, a similar model to dSj) can also be written down as 

E ^ E*, (11) 

f2(nE*) 

where E and E* represent the unoccupied and occupied states of single site respectively; ue 
and ue* are the numbers of unoccupied and occupied sites respectively. Hence, ue+ue* = 
N, and (|lip is equivalent to the model (|3]) as long as the key equality ^^^^^n^!^)^*^ — 

(jV+l-ngO[5] 
nE*K{nE*) 

the substrate 



holds, where K{nE*) is the dissociation constant of the n^^-th molecule of 



These two kinds of cooperativity phenomena both come from the nonlinearity of func- 
tions /i and /2 (i.e. the varying of Ki), but the former emerges from the complex chemical 
reactions while the latter arises from the allosteric interactions between different sites. Ac- 
tually, although there is no direct interaction between the substrate enzymes, the total 

molecules of W and W* are not really independent: they all compete for the single 
kinase and phosphatase and hence there are implicit interactions between them. Because 
this interaction is not through space, but instead is sequential in time, so Hong Qian 
refer to it as temporal cooperativity. 

Moreover, the meanings of the quantity A^ in Fig. [2] and Fig. [TO] are totally different: 
the former represents the total molecule number in the temporal cooperativity model and 
the latter represents the total number of sites on a single enzyme molecule respectively. 
Hence, the degree of allosteric cooperativity is restricted by the total number of sites in a 
single enzyme molecule which can not be very high (see (I12p ) and freely regulated, while 
temporal cooperativity is only restricted by the total molecule number of the target protein 
which can be regulated in a wide range and gives rise to the ultrasensitivity phenomenon. 

In order to be consistent with the previous sections, we still use the symbol (j) here to 
represent the fractional saturation. 

Cooperativity can be generally considered in relation to the Adair scheme, and the 
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general form of Adair equation is 

v^Af (N-iy. e 

2^i=l (i-l)!(iV-i)! nj^i 
~ 1 I N\ C ' 

^ l^i=i i\(N-i)\ n;.^, Ki 

where c = [S] , Kj = ^^[e^s^]^^^'^^ ^® dissociation constant of the j — th molecule of 
the substrate (regardless of site) . 

Consequently, there is an important corollary, that is the Hill coefficient of the [5] — (j) 
curve determined by the Adair equation can not exceed the total number N of sites on a 
single enzyme, i.e. 



= 2— L^i 

alogc ^ 2 



TV „■ (jV-1)! 



< 



Ei=l '(i-l)!(Ar-i)! m K 

^ 2^1=1 i\(N-iy. Yi]^iKj 
[ANcP-AN{cl>)\^i=N. (12) 



It is thought that f^^' "any valid equation to describe binding of a ligand to a micro- 
molecule at equilibrium must be" Adair equation, and in many cases, the Adair constants 
can be actually regarded as "statistical factors" when fitting experimental data. 

In addition, the definition of cooperativity in relation to the Adair constants and the 
Hill plot are not equivalent, and they do not always result in the same sign of cooperativity. 
However, in several simple cases there is good agreement between them 



2c^ 



„3 



For instance, when N = 2, 6 = — then ,f'^ = — — -^-^ — -f"^^^ , and when 

' ^ 1 I 2c I c2 rflogC n I 2e I \9. ' 

= i, the half saturation concentration Kq^^ = \/KiK2. So the Hill coefficient nn = 



2' 

Hence, n > 1 is equivalent to K2 < Ki, and n < 1 is equivalent to K2 > Ki. 



In the subsections below, we will briefly review several famous examples, and our aim 
is to uniformly describe the allosteric cooperative phenomenon by the Adair scheme so 
that to compare with the temporal cooperative phenomenon (See Table [U in this section) . 

6.1 Symmetric model 

Monod, Changeux and Jacob f^'"' studied many examples of cooperative and allosteric phe- 
nomenon, and concluded that they were closely related and that conformational flexibility 
probably contributed for both. Subsequently, Monod, Wyman and Changeux proposed 
a general symmetric model to explain both phenomena, which requires each site can exist 
in two different conformations, R and T, and all sites must be in the same conformation. 
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6.1.1 Two sites 

Symmetric model for a two-site protein is illustrated in Fig. [TTl where A is the substrate. 
This example is from P^l. 

L is the equilibrium constant between the two conformations. and Kt are the 
dissociation constants of the two conformations R and T bound with the substrate A. 
The fractional saturation takes the following form 

_ [R2A] + 2[fi2^2] + [T2A] + 2[T2^2] 

2([i?2] + [R2A] + [R2A2] + [Ta] + [T2A] + [Ta^s]) ' 

Furthermore, 

(l + [A]/if«)2 + L(l + [^]/KT)2 
which can be rearranged into the form of the Adair equation 

[A] [A]^ 
, _ Ki K1K2 



1 . 9MI . 



where the dissociation constants = , z^^"!"^,^ . and = ^^^^ ■ 

According to the Cauchy inequality, one has Ki > K2, which implies positive cooper- 
ative phenomenon. Moreover, Ki > K2 is equivalent to the condition that < L < 00 
and Kji / Kt- 



6.1.2 N sites 



Straightforward generalizing the results above to the case of sites, one has 
-^^[Af/K},, = L^r^[AY/K^, i = 1, 2, • • • , A. The fractional saturation 

^ _ (1 + [A]/Kn)''-HA]/Kn + L(l + [A]/Kt)''-'[A]/Kt 



{1 + [A]/Kr)^ + L{1 + [A]/Kt: 



N 



(13) 



which can be also rearranged as the Adair equation, where the dissociation constants 

1 L_L 



Ki= I^.jL ,i=l,2,--- ,N. 

Similar to the case of two site, one can derive Ki > ATj+i, which also implies positive 
cooperativity. 

When Kr ^ Kt, the steepness of the curve passes through a maximum when L = 



'^^1. The half-saturation concentration ATq.s = V^R^T and the Hill coefficient uh 



(ilog[A] 10=1 ^ n , [K' 
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6.2 Sequential model 

Koshland, Nemethy and Filmer showed a more orthodox apphcation of induced fit 
theory [40-42]^ known as the sequential model. They also postulated the existence of two 
conformations, but one of them is induced by ligand binding. 

6.2.1 Dimer 

Sequential model of a two-site protein is illustrated in Fig. [T2l recapitulated also from P^' . 

Basic parameters: Kt is the notional equilibrium constant of the conformation change 
T ^ R {Kt = \T]/[R\ S> 1), and Ka is the dissociation constant of the conformation R 
bounded with a molecule of the substrate A. Moreover, in order to consider the interface 
across change, we should introduce the parameters K^-t and Kji-ji, representing the no- 
tional equilibrium constants for the interface of the two sites changing from T : T to R : T 
and R : R respectively. 

Hence, [TRA] = .^d [R,A,] = ™T^^ = which give rise 

to the fractional saturation 



\A]K[i,T , IA]^Kr,r 

[TRA] + 2[R2A2] ^IKT + K'fKl 



2m + [TRA] + [R2A2]) 1 + + 



KtKA ^ K'iK\ 



Let c2 = ^ and K = then 



c[A]lK^[AflK^ 
^ l + 2c[A]/K + [AY/K'^' 

which is an Adair equation with the dissociation constants Ki = K/c and K2 = cK. 

Consequently, c > 1 implies the negative cooperativity, while c < 1 implies the positive 

cooperativity. 

6.2.2 Quaternary structure 

Basic parameter: K is the equilibrium constant of single site bound with a substrate 
molecule A, and y represents the interaction energy (similar to the famous work of Pauling 

[43] 

Hence the fractional saturation 

AK[A] + 2{4:K^[Afy + 2K'^\Af) + l2K^[Afy'^ + 4K^[A]^y^ 

~ 4(1 + 4:K[A] + 4^2 [^]2y + 2/^2 [^]2 + 4K^[A]3y2 + i^4[^]4y4) ' 

which can also be expressed as the Adair equation with the Adair constants Ki = 
■^2 = {2y+i)K ' ~ 3y^K ~ ^ence, if 7/ > 1, there is a positive cooperativity, 

and if y < 1, there is a negative cooperativity. 
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It is just the example used by Hong Qian '^"1 in order to explain the relationship be- 
tween temporal and allosteric cooperativity phenomena. But the analysis there is some- 
what vague and incomplete. 

7 Discussion 

Nowadays, an era of quantifying the signaling processes in terms of physiochemical princi- 
ples is emerging . Quantitative understanding and mathematical modeling of biolog- 
ical systems presents a significant challenge as well as an unique opportunity for scientists 
of diverse disciplines. 

During the theoretical development of signal transduction network, sensitivity plays 
an indispensable role, and the mechanism of high sensitivity, for instance the zero-order 
ultrasensitivity I^', may be needed for the adaptive sensory systems, in which one pathway 
must be turned on and another pathway turned off. 

Although the sharp activation in PdPC switches have always been compared to al- 
losteric cooperative transitions it has never been made very clear what the essential 
similarities and differences between them are. This significant question could date back 
to Fischer and Krebs [i-^^l, who discovered protein phosphorylation as a regulatory mech- 
anism for enzyme activity and won the Nobel Prize in 1992. 

While the requirements for both nonlinearity and nonequilibrium are intuitively obvi- 
ous [11' 1*1, quantitative aspects of such a system have never been studied until Qian's work 
[9' 101, which answered one aspect of this basic question. He suggested that the essential 
difference between the allosteric mechanism and the hydrolysis cycle is that the former 
does not expend energy: "The costs of the two types of regulations are quite different. One 
requires a significant amount of regulator biosynthesis in advance. The other requires only 
a small amount of regulators for the hydrolysis reaction, but it consumes energy during 
the regulation." [i°l 

The thermodynamic analysis for the phosphorylation-dephosphorylation cycle (PdPC) 
is provided (See Section 2 and Appendix) to confirm the conclusion that 7 is the unique 
control parameter for the nonequilibrium steady state. Then in Section 3, it is shown that 
the key result in Ref. '^1 also holds in the stochastic model, which implies that the PdPC 
switch is a phenomenon only exhibited in nonequilibrium steady states. 

Our quantitative analysis provided a clear mechanistic origin for the high cooperativity 
in the zero-order ultrasensitivity. A reduced chemical master equation (Fig. [2]) indicates 
that the mechanism of temporal cooperativity is parallel in mathematical form to, but 
fundamentally different in biochemical nature from, the allosteric cooperativity of multi- 
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subunits protein systems, where the dissociation constants play the key role. 

Nevertheless, the degree of allosteric cooperativity is restricted by the total number 
of sites in a single enzyme molecule which can not be freely regulated, while temporal 
cooperativity is only restricted by the total molecule number of the target protein which 
can be regulated in a wide range and gives rise to the ultrasensitivity phenomenon. That 
is just why the organisms find it advantageous to develop the mechanism of covalent 
modification via phosphorylation and ATP hydrolysis to control the biological activity of 
proteins rather than the mechanism of allosteric transitions. 

Therefore, the improving of the total number of molecules of target protein can not 
increase the degree of allosteric cooperativity, while it can obviously increase the degree of 
temporal cooperativity , indicated by the increasing gradients of the fractional saturation 
function {(p) (Fig. [8|) and the decreasing dissociation constants {Kj, j = 1,2,- •• ,N} 
(Fig. ED! 

On the other hand, the present research also emphasizes that nonlinearity of the for- 
ward and backward fluxes is another requirement for sharp transitions with ultrasensitiv- 
ity. Moreover, we express the nonlinearity by the varying of dissociation constants, which 
exhibits the essential difference between the simple and ultrasensitive PdPC switches (See 
Fig. [5] and Fig. El- 

Finally, it is often thought that the noise added to the biological models only provides 
moderate refinements to the behaviors otherwise predicted by the classical deterministic 
system description, while in the present paper, it is quite clear that the main result, 
namely the mathematical equivalence between temporal and allosteric cooperativity can 
only be explicitly expressed by the chemical master equation model (See Fig. [2]), where 
nonequilibrium is hidden in the parameter 7 7^ 1. 

The concept of temporal cooperativity in terms of the random- walk model is not limited 
to PdPC and kinetically isomorphic GTPases, but also applies to many other signaling 
processes 
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8 Appendix 



8.1 Complete mathematical models and nonequilibrium steady states 
8.1.1 Deterministic model: mass action law 

Biologists usually build the deterministic model of biochemical systems from the macroscopic 
view. Based on the mass action law, the forward and backward fluxes of chemical reaction Al 
are Ji = ai[W][i?i] and J_i = c?i[VFi?i] respectively; similarly, the forward and backward fluxes 
of chemical reactions A2, A3 and AA are J2 = ki[WEi], J_2 = gi [VF*] [£^1], J3 = a2[W^*][£;2], 
J-3 = d2[W*E2], Ji = k2[W*E2] and J_4 g2[VF][£;2] respectively. 

We can choose \W*], [Ei] and [E2] as independent variables according to the three restrictions 
Wt = [W] + [WEi] + [W*E2] + [W% EiT = [El] + [WEi] and E2T = [£^2] + [W*E2], where 
Wtj EiT and E2T are constants representing the total concentrations of target protein, kinase and 
phosphatase respectively. Then the deterministic equations are 



d[W*] 

dt 
d[Ei] 

dt 
d[E2\ 

dt 



J2 — J -2 + J-3 — J3', 

J-3 + J-4. (14) 



In the steady state, the right side of (fT4|) is set to be zero, which leads to the important definition 
of the net flux J =^ J, - J_j, i = 1, 2, 3, 4. Based on the relation 7 iiihil^ = J1./2./3J4 
will know that J > is equivalent to the energy parameter 7 > 1 ; and J < is equivalent to 7 < 1 . 
Moreover, the entropy production which is a key concept in nonequilibrium thermodynamics can 
be expressed as 

ep = flux X potential — Jlog7. 

Obviously, ep = if and only if 7 = 1, which means chemical equilibrium state according to 
the thermodynamic analysis in Section fS. 1.31 

In addition, it is necessary to note that we have a nonlinear system, where the well-known 
King-Altman method l^^' fails. 

8.1.2 Chemical master equation of the complete model 

A deterministic model, however, only describes the averaged behavior of a system of large pop- 
ulations, and can not capture the temporal fluctuations of a small biological system with either 
extrinsic or intrinsic noise. Hence stochastic models with chemical master equations (CME) based 
on biochemical reaction stoichiometry, molecular numbers, and kinetic rate constants are worth 
being applied. 

Denote the volume as V, which is a fixed parameter of the system. And let Nt = WtV, 
Nit = EitV and N2T = E2tV, recalling Wt = [W] + [WEi] + [W* E2] + [W*], Eit = [Ei] + [WEi\ 
and E2T = [E2] + [W*E2] are constants representing the total concentrations of target protein. 
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kinase and phosphatase respectively. So we can stiU choose the molecule numbers of species W* , 
El and E2 as three independent variables. Let P{i,j, k; t) be the probability of the event that the 
molecule numbers of species W* , Ei and E2 at time t are i,j and k respectively, which satisfies 
the chemical master equation 



dP{iJ,k;t) 
dt 

= '^{NT-NiT-N2T-i + ] + k + + l)P{i,j + 1, k- 1) + di{NiT - ] + l)P{i,j - 1, k- 1) 

+ fci(^iT - j + l)P{i -1,3- 1, k; t) + '^{i + l){3 + l)P{i + 1,3 + 1, k- 1) 

+ y{i + l)(fc + l)P{i + k + l:t) + d2{N2T -k + l)P{i - k-l;t) 

+ k2{N2T -k+ l)P{i, j, k-l-t) + ^{NT- NiT -N2T-i + ] + k + l){k + l)P{i, j,k+l;t) 

- [yi^T - NiT -N2T-1+3 + k)j + di{NiT - ]) + fci(A^iT - 3) + 

+ + d2{N2T -k) + k2{N2T -k) + ^{Nt - Nit - N2T - i + ] + k)k]P{i,j, k; t). (15) 

It is necessary to explain the discrete population coefficients in the above equation. When the 
system is in the state k), the molecular numbers of WEi, W*E2 and W are Nit — j, N2T ~ k 
and Nt — i — [Nit — j) — {N2T — k) respectively. Moreover, the parameters ^ and ^ are 

called "stochastic rate constants" I"''^', and their relationships with the original rate constants oi, 
a2, qi and (72 have been developed in Ref. '^^l For instance, the quantity Ji = ai[iy][i?i] is in 
the unit of concentration, hence the stochastic rate Ji x V — aiV x - Wit - jV2r -»+ j+fc ^ j. _ 
^ (Nt — NiT — N2T — i+j + k)j should be in the unit of molecular numbers when we build chemical 
master equations. 

This is a continuous-time jumping process on the three-dimensional cube Nt x Nit x N2t- 
The state k) can only jump to the adjacent states (i, j -I- 1, fc), {1,3 — 1, fc), {i — 1, j — 1, fc), 
{i + 1,3 + l,k), [i + l,j,k + 1), (i - l,j, fc - 1), {i,i,k- 1) and {i,j,k + 1). 

In probability theory, such a random-walk model is called the three-dimensional birth-and- 
death process, which is a special Markov chain. Generally speaking, ^ and i] represent the states 
and q^ri is the transition density along the passage ^ — > ^y. The equation (I15|) is just the Kolmogorov 
forward equation (also called the Fokker-Planck equation) of the continuous-time Markov chain 
with transition density matrix Q = (g^,,) 

^^ = p«.w, m 

where ^ — {£,^ , ^'^ , S,^) represents the state in which the molecule numbers of W*, Ei and E2 are 
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and respectively, and 



^{NT'NiT-N2T-i+j- 


l-fc)j 


^ = 


k),r] = 




di{NiT-j) 






ihj, k),T] = 


- l,k), 


ki{NiT-j) 




e = 


{■ij, k),T] = 


{■i - 1, j - 1, k), 








k),T] = 


(i + l,j + l,fc), 






e = 




(i + l,j,fc+l), 


d2{N2T - k) 




e = 


{i,j,k),T] = 


(i - 1, j, k - 1), 


k2{N2T - k) 




c = 




{hi-k~ 1), 


f{NT~NiT~N2T-i+j- 




? = 


k),T] = 


fc + 1), 






c = 


?7 = {hi,k), 









else 







8.1.3 Rigorous thermodynamic analysis 

1. From the perspective of the deterministic(macroscopic) model, the system is in equilibrium 
state, if and only if the forward and backward fluxes of each chemical reaction are equal, i.e. 
Ji = J-i, J2 — J3 — J-3 and J4 = J_4. Hence 7 = 1 is necessary for the equilibrium state. 

For the sufRciency, we have to show that if 7 1, there exists an unique reasonable solution 
under the equilibrium conditions Ji = J-i, J2 = J3 = J-3 and J4 = J_4. 

Since Ji = J_i imphes [WE,] = 2^% ^ = ^-3 impHes [W*E2\ = ggp^ and Ji J2 = 
J_iJ„2 imphes [W*] ^ ^[W]; then, the equahty Wt = [W] + [WEi] + [W*E2] + [M^*] becomes 

^"^J + + ai[W^] + d2 + a2t|-[W^] ^ ^' 

The right side is an increasing function of [W], and it equals zero when \W] = and is larger 
than Wt when \W] = Wt- Hence the above equation has an unique reasonable solution between 
and Wt- 

Finally, it could be rigorously proved that the ordinary differential equations ([14]) only have 
an unique fixed point (See Section [8.4p . which finishes our proof for sufficiency. 

2. From the perspective of the stochastic (mesoscopic) model, we should appeal to the chemical 
master equation (fTS]) . In the mathematical theory of nonequilibrium steady states I**'*^], there is 
a famous condition named "Kolmogorov's cyclic condition" (Sec Section IS.Sp . which is equivalent 
to the reversibility (equilibrium) of the specific Markov chain. The priority of this condition is that 
one can directly write down the condition for reversibility without deriving the steady states first. 
Although there are many many cycles in the Markov chain model (jlSp . every large cycle can be 
decomposed into several basic four-state cycles 

6 = {hJ.k) £.2^ -l,k) ^ £,3 = {i + l,j,k) ^4 = {hj,k- I) -> £,1 = {i,j,k), 

which just accords to the kinetic phosphorylation-dephosphorylation cycle. 

In this case, the necessary and suflBcient condition for the steady state being in equilibrium, i.e. 
the Kolmogorov cychc condition, is expressed as g^iC29?2C3'7«3?4'?«4?i = 'l(.iU(lUi3li3i2H2ii- From 
p5|). this is just 
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y{NT - NiT - N2T + k)j X ki{NiT -j + l)x y{i + l)k X k2{N2T ~ k + 1) 

= yi^T - NiT - N2T + k)k X d2[N2T - fc + 1) X + I)] x di[NiT - ] + 1). 

Hence one can derive that 7 = a-ikxa2k2 _ 

I diqid2q2 

Namely, 7 7^ 1 is equivalent to the fact that this system is in a nonequilibrium steady state. 

8.2 The complete and reduced models share the same steady state 

The rationality of the reduced model ([3]) is based on the fact that its steady state satisfying 
— f2{\W*Y'^) is the same as that of the complete model (fT4| . under the restriction 

The steady state of the complete model satisfies that 

ki[WE{\ - qi[W*Y'[Ei\ + d2[W*E2\ - a2[W*Y-'[E2\ = 0, (17) 

di[WEi] - ai[WY-'[Ei] + ki[WEi] - qi[W*Y'[Ei] = 0, (18) 
d2[W*E2] - a2[W*Y-'[E2] + k2[W*E2] - q2[WY'[E2] = 0. (19) 

From ITSll. 



{d,+k,)E,T {ai[WY'+qi[W*YnEiT 



di + ki + ai[WY'' + qi[W*Y'' di + ki + ailWY" + qi[W*Y'' ' 

and from (dH), 

{d2+k2)E2T [W*E2'- fe[W^]''+«2m^^)i?2T 



^ ' d2 + k2 + q2[WY' +a2[W*Y'' d2 + k2 + q2[WY'' + a2[W*Y'' ' 

which combined with (|17p gives 



^ {ai[WY^+qi[W*YnEiT _ .^.,ss (di + ki)E,T 



di + ki + ai[WY' + qi[W*Y'' di + ki + ailWY" + qi[W*Y 

{d2 + k2)E2T J {q2[WY' + a2[W*Y')E2T 



a2\W 



d2 + k2 + q2[WY'' + a2[W*Y'' da + fcz + 92 [M^]''^ + a2[W*Y' ' 
which is just the equation /i([T4^]"") = f2{[W*Y")- 

8.3 Derivation of the steady distribution in the reduced stochastic model 

Let the right side of ^ equals zero, which gives 

f2{l/V)VP'%N - 1, 1) - fi{N/V)VP'%N,0) = 0; 

fi{{N + 1 - t)/V)VP'''(N + f2{{i + 1)/V)VP''{N + 

-[/i((7V ~ t)/V) + f2{i/V)]VP''iN - z, z) = 0, i = 1, 2, • • • , TV - 1; 
/i(l/y)yP""(l,7V - 1) - f2iN/V)VP'''iO,N) = 0. 
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So 

h{N/V)VP''{N,{)) - h{l/V)VP''{N ~ 1, 1); 

h{{N + 1 - i)lV)VP''{N +1-1,1-1)- h{ilV)VP''{N - I, i) 

= h{{N - i)/V)VP''{N h{{i + l)/V)VP''(N - 1 - z + 1), z = 1, 2, • • • , TV - 1; 

h{l/V)VP'\l,N -I) = h{N/V)VP''{0,N). 

Then applying the iteration technique, we have 

h{{N + 1 - i)/V)VP'^N + l-i,i-l) = h{ilV)VP''{N - i), i = 1, 2, • • • , iV, 

which means in the steady state, the ratio of the probabihties of the states {N — i, i) and {N, 0) is 



fi{(N+l-j)/V)V 
f2{j/V)V 



fii(N+l-])/V) 



Consequently, the steady distribution of {N — is 

Yfi h{(N+l^j)/V) 



^=1 TIUTW 

8.4 Existence of the unique reasonable solution in the deterministic 
model of the PdPC switch 



Based on the analysis in Section 18.21 we have already known the steady solutions of the complete 
model (fT4)) and reduced simple model ^ are the same, i.e. both satisfying 

On the other hand, according to the analysis in Section [2.1.11 we also have known that under 

Wt 

+ 1)0](0 - §^^^)K,mK*, - k,) 



the assumption Wt > Eit + E2T (i-e. Wt = [W] + [W*]), = ''^Q— satisfies 



[M7 - (M7 + 1)0](0 + ™gg)ifii^r(if2 - K*) ■ 

Define 

5(0) = a^7[m - (m + 1)0](0 - )K2Kl{Kl - K,) 

[K^ - Ki)Wt 

which is a quadratic equation. Hence we only need to prove g{0) < and 5(1) > 0. 



is obvious. 
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And 



g{l) = M7(-l)(l 



-^(-1)(1 + 



{K* - Ki)Wt 
K*iWT + K2) 
{K2 - K*)Wt 



)K2k;{k*-k,) 



)KrKl{K2-K*2) 



is also obvious, because 



(KI-K^)Wt 



> 1. 



Therefore, there is only one solution of g{(j)) = in the interval [0, 1]. 

8.5 Kolmogorov cyclic condition 

This subsection is recapitulated from 1**1. 

Suppose that X is an irreducible and positive-recurrent stationary Markov chain with the 
countable state space S*, the transition density matrix Q = {qij)i,jeS and the invariant probability 
distribution 11 = {-Kiji^s, then the following statements are equivalent: 

(i) The Markov chain X is reversible (equilibrium) . 

(ii) The Markov chain X is in detailed balance, that is. 



(iii) The transition probability of X satisfies the Kolmogorov cyclic condition: 



Qi3i2^i2ii 1 



for any directed cycle c = (ii, • • • , is). 
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List of Figure Captions 



Fig 1: The reduced model of PdPC switch. 

Fig 2: The illustrated chemical master equation of the reduced model of the PdPC switch. 
The two dimensional vector {N — represents the random state that the molecule number of 
the species W is {N — i) and the molecule number of the species W* is i. 

Fig 3: The curve of cj) with respect to Eit in the deterministic model of the simple PdPC 
switch without the first-order linear approximation, where the parameters are the same as that in 
Fig. H 

Fig 4: The curve of {(p) with respect to Eit m the stochastic model of the simple PdPC switch 
without the first-order linear approximation at different volumes, where the parameters are the 
same as that in Fig. O 

Fig 5: The dissociation constants in the simple PdPC switch with different volumes, where 
ai = 0.01; di = l;/ci = l-q^ = 0.0001; £:it = 0.01; as = 0.01; ^2 = l;fc2 l;q2 = 0.0001; £;2T = 
0.01; Wt = I, and a = [Vi/Ki + V2I K2) / [Vi/ Ki + V2IK2) ^ 1. The volume V takes different 
values as 10, 20, 50, 100 and 150, namely the total molecule number N — WtV takes values 10, 
20, 50, 100 and 150 respectively. The horizontal line represents the quantity 1/a, which equals all 
the dissociation constants under the hrst-order assumption. 

Fig 6: The curve of {(f)) with respect to Eit at different volumes in the stochastic model of 
ultrasensitive PdPC switch under the zero-order approximation, where the other parameters are 
the same as that in Fig. O 

Fig 7: The curve of 4> with respect to Eit m the deterministic model of the ultrasensitive 
PdPC switch without the zero-order approximation, where the other parameters are the same as 
that in Fig. H 

Fig 8: The curve of {<j>) with respect to Eit of different volumes in the stochastic model of the 
ultrasensitive PdPC switch without the zero-order approximation, where the other parameters are 
the same as that in Fig. [9l 

Fig 9: The dissociation constants in the ultrasensitive PdPC switch, where ai = 10; di = 
l;fci = 1.5; gi = 0.0001; £;it = 0.01; 02 = 10; ^2 = 1:^2 = 1-5; 92 = 0.0001; £;2T = 0.01; VI^t = 10; 
and a — VijV^. The volume V takes values as 1, 2, 5, 10 and 100, and the molecule number 
N ^WtV are 10, 20, 50, 100 and 1000 respectively 

Fig 10: Ceneral model of the allosteric cooperative phenomenon, where E is the enzyme, S is 
the substrate and c— [S]. 

Fig 11: Symmetric model for a two-site protein. 

Fig 12: Sequential model of a two-site protein. 

Fig 13: Sequential model of quaternary structure. 
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Figure 3: 
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Figure 7: 
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Standard Models 


Dissociation constants 


Temporal 
cooperativity 


General model(Fig. [2]) 


_ iN+l~i)f2ii/V) 
- ih({N+l-i)/V) 


Simple PdPC switch model 




Ultrasensitive PdPC switch model 


N+l—i V^+V.f 
J^i ~ i V1+V2 


Allosteric 
cooperativity 


Symmetric 
model 


Two sites 


Ki = K2 = 

1 . T, ^ ^ 


N sites 




Sequential 
model 


Dimer 


Ki = K/c, K2 = cK 


Quaternary 


ft- _ 1 3 2y+l 1 



Table 1: Summary: a compare of temporal and allosteric cooperativity models through 
dissociation constants. 
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